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Abstract 

We introduce the notion of relative volume entropy for two spacetimes 
• • with preferred compact spacelike foliations. This is accomplished by 

. ^ applying the notion of Kullback-Leibler divergence to the volume el- 

^ ements induced on spacelike slices. The resulting quantity gives a 

lower bound on the number of bits which are necessary to describe 
one metric given the other. For illustration, we study some examples, 
in particular gravitational waves, and conclude that the relative vol- 
ume entropy is a suitable device for quantitative comparison of the 
inhomogeneity of two spacetimes. 
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1 Introduction 



How much information is required to describe one spacetime in terms of 
another? More detailed manifestations of this question are: Just how much 
more complex is a solution of the Einstein equation in the presence of matter 
than a vacuum solution? How "complicated" is a gravitational wave? In 
this paper, we provide a possible answer to these questions in terms of the 
relative entropy of the volume elements associated with the metric tensors of 
two given spacetimes. 

Our approach is inspired by two well-known facts: 

• In mathematical information theory, relative information is measured 
by the Kullback-Leibler divergence, or relative entropy, of probability 
measures pQ. 

• In order for our answer to make sense, we want it to be a diffeomorphism 
invariant of the ordered pair of metrics. A natural covariant of a pseudo- 
Riemannian metric is the Radon-Nikodym derivative of its associated 
measure on spacelike slices]]] 

We therefore propose to compute the relative entropy of two continuous prob- 
ability distributions associated with our metrics, namely the normalized vol- 
ume densities in spacelike slices. 

For this method to make sense without further complications, we restrict 
ourselves to the following situation. Suppose we are given a topological space 

M = R t x X, 

where X is compact, and two metrics 

gWdafdx" = -dt 2 + 1 { ^dx i dx i (k = 1, 2; i, j = 1, . . . , d) 

on M. Define the normalized volume densities by 

Pk = y^detT^/volfe, (1) 

where 

vol fc = J d d x ^det 7 f . (2) 

1 Recall that the Radon-Nikodym derivative dv/dfi of two measures v and fj,, with v 
absolutely continuous w.r.t. /i, is a function (f> such that J f dv = Jf ■ <f>d[i. Here, 4> is 
unique up to a set of ^(-measure zero, compare [2], Ch. 19. Intuitively, we can think of the 
Radon-Nikodym derivative as a Jacobian for measures. 
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Then 

pk d d x 

is proportional to the physical volume in a (natural) spacelike slice corre- 
sponding to the coordinate volume d d x. 

Mathematically, the normalized volume densities can be interpreted as 
probability measures on X (though we are still dealing with entirely deter- 
ministic physics). In a spacelike slice, they are absolutely continuous w.r.t. 
each other, and the Radon-Nikodym derivative of the measures p% d d x and 
p 2 d d x is equal to pi/pY 

We now introduce the Kullback-Leibler divergence (relative entropy) of 
our volume densities, the relative volume entropy, as 



E(p2||pi) = J d d x p 2 \og(p 2 /pi 



The well-known information theoretic meaning of this entropy is that it 
measures the number of "nats" (or bits if we took the logarithm to the base 
2) that are necessary to describe the volume density p 2 when given pi. 

For our problem of comparing spacetimes, this implies the following re- 
suit: At least E • log 2 e bits will be necessary to describe {M^g^J) in terras of 

The relative entropy is known to be strictly positive for pi ^ p 2 , and in- 
variant under coordinate changes on spacelike slicesj^] For example, isometric 
metrics have vanishing relative entropy, since the volume elements transform 
by a trivial Jacobian. 

Of course, our proposed information measure neglects some relative in- 
formation by focussing solely on the volume densities. It appears to be a 
good measure for the difference in inhomogeneity between the metrics. 

To illustrate this last statement: A Kasner solution in any dimension 
D > 3 has zero relative entropy over a Minkowski background, since its 
normalized volume density is independent of the parameters of the solution, 



cf. Section 2.1 On the other hand, cosmological solutions in 2 + 1-dimensions, 
whose volume densities have a "lumpy," soliton-like behavior over a given 
vacuum background^ have a rather interesting relative entropy, cf. Section 

2 It is a basic irritant in information theory that for continuous distributions the usual 
"differential entropy" J d d x p2 log^) does not have these properties and one needs to fix 
a "background distribution" p\. This is very much in line with Jaynes' viewpoint that 
entropy depends on a choice of reference frame [3]. 

3 Similar spacetimes where studied by Deser-Jackiw-'t Hooft |HH], and later in [6]. 
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2.2 For example, when space is spherical (X = S 2 ), and we place n — 1 
particles on the sphere, so that the resulting volume density is p n , we obtain 
a relation of the form 

E (Pn||po) ~ logn (n->oo). 

This certainly is a very satisfying result: The more particle sources are in 
the energy-momentum tensor, the more information is necessary to describe 
spacetime over a vacuum background. By numerical integration, the very 
same result appears to hold true also for X = T 2 , so we see that the relative 
entropy has little to do with cosmic topology, but rather with the amount of 
local fluctuation in volume. 

We now proceed to work out some examples, in order to illustrate how 
the relative volume entropy behaves for different classes of spacetimes. 

2 Examples of relative volume entropies 

Here we study the relative volume entropy of Kasner metrics over (toroidal) 



Minkowski space (Sect. 2.1), of cosmological spacetimes in 2 + 1 dimensions 



with a positive cosmological constant (Sect. 2.2), and of exact gravitational 



waves in (toroidal) Minkowski space (Section 2.3) 



2.1 Kasner metrics vs. Minkowski space 

Let 

M = R t xT d (d>2), 

where T d is the d-torus. 

The Kasner metric on this space is (see e.g. [7J) 

d 

^ S Kasner = ~dt 2 + t 2lPl (dx*) 2 , 

1=1 

where the parameters pi satisfy 



J> = 1, = (3) 



1=1 8=1 

and the coordinates on the torus are periodic with period- length 1. 
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Since 

(Kasner) ,2p, r / -\ 

7>- = r ^Ojj (no sum on «), 
using the first relation in (|3]), we find that the volume (|2| of Kasner is 

Volj<asner t : 

so that the normalized volume density (jlj reads 

PKasner 1 j 

just the same as for the Minkowski metric: 

PKasner PMinkowski- 

Consequently, 

E(pKasner 1 1 PMinkowski) = 0. 

At face value, this result is hardly surprising, as the Kasner metric is just 
"expanding Minkowski space." As mentioned in the Introduction, the rel- 
ative volume entropy detects the difference in inhomogeneity between the 
metrics. 

2.2 Cosmology in 2+1 dimensions with A > 

A more interesting relative volume entropy arises for certain 2+1-dimensional 
"cosmological" spacetimes with cosmological constant A > and pointlike 
matter. 

Let's begin by reviewing the basic features of these spacetimes jU [5j [6]. 
The spacetime topology is 

M = R t x X 2 , 

with metric 

ds 2 = —dt 2 + a(t) 2 "fij dx l dx\ 

where X 2 is a compact surface. We choose isothermal coordinates x, y on 
X 2 and write the metric as 

ds 2 = -dt 2 + a(t) 2 e^(dx 2 + dy 2 ), (4) 
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and the Einstein equation as 



where, following [4J, we take T M „ to be of the form appropriate for a cloud 
of non-interacting point particles % of mass m« sitting at fixed coordinates 



Too = a(t)- 2 e"^m^ 



2) ff - fj), 




T^ = for (^,1/)^ (0,0). 

By distributing the point particles in a suitable manner over the manifold 
X 2 , one can obtain a matter distribution which satisfies the cosmo logical 
principles of homogeneity and isotropyj^] 

Plugging in our metric ansatz into the Einstein equation, we find that the 
only non-trivial components ard^ 

i> 

-A0 - A = a" 2 e-* V m^ix - xA, 
2a 2 Y i (5) 

-e^aa + AaV = 0. 
The second equation in <^ is readily integrated to give] 
a(t) = C\ cosh y/Xt + sinh y/Xt. 
For convenience, let us pick the solution where C\ — 1 and C2 = 0, such that 

ait) = cosh y/Xt. 

Then, after a change of variables = p, the first equation in ^ becomes 
A\og^ + A P = -^2m i 5^(x-x i ), (6) 

i 

4 Possibly modulo some subtle mathematical constraints. For the example of three 
particles, see [5]. 

5 We define A = d% + d%. 

6 This result is at variance with [6], where the scale factor is polynomial in time, rather 
than exponential. This appears to be based on a slip in the integration in loc. cit. 
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the well-known Liouville equation with point sources. From the equation it 
follows that, outside the sources, the metric has constant curvature A. From 
eqns. Q and (|2]), we find that at time t, the universe has volume 



J pd 2 xj ■ cosh 2 (\/Ai), 



vol(t) = 

that is, we have a bouncing solution with initial volume 

vol(t = 0) = / pd 2 x. 



We note that the normalized volume density Q now reads 

P 



P 



J pd 2 x 



Observe how any dependence on time has disappeared. 

We now specialize to the case where X 2 = S 2 is a sphere. 

2.2.1 The sphere 

In the absence of matter (m 8 = 0), we find a unique solution to the Liou- 
ville equation ([6f , corresponding to the round metric of radius 1 / y/X (initial 
volume 47r/ A), which we write as 

ds\ = pi(dx 2 + dy 2 ), 

where 

The introduction of point sources gives rise to different, non-round metrics 
on 5* 2 . For example, if 

f(z) = ^ 

f[) Q(z) 

is a rational function of the complex variable z = x + iy, then 

4 \f(z)\ 2 



Pf 



A(l + \f(z)\ 2 ) 2 
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gives a solution to equation ([6]), for a suitable choice of particle positions and 
masses]^] It follows from [9J that in this case, the initial volume is 

vol(t = 0) = ^-ord oo (/), (7) 

where ordoo(/) is the number of poles of f(z). 

For deg(/) 7^ 0, 1, this solution has a different character from the every- 
where constant curvature solution pi (which arises for f(z) = z). Indeed, at 
the zeros of 

P'(z)Q(z)-P(z)Q'(z), 
the metric Pf(dx 2 + dy 2 ) has a conical singularity. 





(a) Shown is p%, that is, the solution of the (b) Solution of the Liouville equation associ- 
Liouville equation corresponding to zero par- ated with the function f(z) = l/z+l/(z — 1). 
tides (f(z) = l/z). 



Figure 1: Two solutions of the Liouville equation for X 2 = S 2 . 

Figure [l] shows a plot of pf where f(z) = 1/^ + 1/(^ — 1), and also of p\. 
The striking feature of the relative entropy of pf w.r.t. to pi, i.e. 

E(p/||pi), 

is that it is independent of our isothermal coordinates and is sensitive to the 
lumps we see in the plots. 



7 Thcsc solutions were already studied in connection with the Jackiw-Pi model, for 
example by Horvathy and Yera [9]. 
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In the example of a radially symmetric solution p n = p z n corresponding 
to the power f(z) = z n , it is not too difficult to see that 



E (Pn||/>l 



Pn log [y)d 2 x = log // 2(J„ - 1). 



where 



J n 



dx 



[l + x)(l + x n ) 



-)-log2 (n^oo). 



Physically, the solution p n arises when there are n — 1 particles of mass 
m = — 2tt at the north pole of S 2 and n — 1 particles of the same kind 
at the south polej^] Thus, here the relative volume entropy encodes the 
number of particles n. Alternatively, we can think of two particles of mass 
m = —2n(n — 1) each, one sitting at the north pole, the other at the south 
pole, and in this interpretation, n need not be an integer. Figure [2] shows a 
plot of E(p n \\px) iorX 2 = S 2 . 

E (Pn||Pl) 




Figure 2: E(p n ||pi) for X 2 = S 2 . 



2.2.2 The torus 

Here, just as for the sphere, we have at our disposal very many explicit 
solutions of the Liouville equation with distributional sources [TDJ [TT] . 



8 The appearance of negative masses need not disturb us here, as long as we are talking 
about a toy model. 
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We want to emulate our discussion for the sphere, but immediately we 
are faced with the problem that on the torus with A > there does not 
exist a zero particle solution (this follows from the Gauss-Bonnet theorem 
for generalized Riemannian surfaces, compare [H]). The least number of 
particles allowed is equal to one. The solution with precisely one particle of 
mass m = —2tt located at the point (0, 0) on the torus was discovered by 
Olesen [121 03] and is given by 



Po = 



4 | 


P'\ 


21 


ei| 


2 


A (Id 


12 


+ 1* 


>| 2 ) 2 



Here, 

is the Weierstrass pe-function associated with the lattice 2Z + 2iZ, and e\ = 
By considering analogous solutions on the lattices 

2Z+-2iZ (n = 1,2,3,...), 
n 

it is easy to construct n particle solutions of the Liouville equation on the 
torus (cf. [10], eqns. (25), (65), (66)) correspoding to one particle of mass 
m = —2tt sitting at each of the points 

(0,0),(0,l/n),(0,2/n),... 

Call these solutions p n (so that p% = po). Examples are shown in Figure [3] 
Calculating the relative entropy 

E(pn\\po) 

by hand seems like a formidable task. However, numerical computation is 
simple enough and the outcome is shown in Figure |4} Remarkably, the result 
as a function of n is the same as that for the sphere (within the bounds of 
numerical accuracy)! This result is the basis for our claim in the Introduction 
that the relative entropy appears to be quite insensitive to global topology. 

2.3 Gravitational waves 

Our final example is the relative volume entropy of an exact gravitational 
wave on a torus w.r.t. Minkowski spacej^] 

9 To the best of our knowledge the class of periodic gravitational waves presented below 
is new. 
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(a) Shown here is Olesen's periodic solution (b) Shown here is P2, a solution of the Liou- 
of the Liouville equation pi = pQ, corre- ville equation corresponding to one particle 
sponding to a single particle at (0, 0). at (0, 0) and another one at (0, 1/2). 

Figure 3: Two solutions of the Liouville equation for X 2 = T 2 . 



We first exhibit a class of gravitational waves in toroidal space. Let 

M = R t x[0,L] 3 (L = 0). 

For the metric, we make the plane wave ansatz 

ds 2 = -dt 2 + f(z - tfdx 2 + g(z - tfdy 2 + dz 2 , 

where f(u) and g(u) are L-periodic functions. The vacuum Einstein equa- 
tions now imply 

f" a" 

V + - = 0. (8) 
/ 9 

We can write down L-periodic solutions to this equation in terms of Mathieu 



functions 10 as follows 



Let q > be a solution to the equation 

a n (qo) = -b m {-q ) (m, neW), 

where the as and 6s are the characteristic values of even, respectively odd 
Mathieu functions. 
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Compare Whittaker and Watson [TJ] or [TS]. 
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E(PnllPo) 




Figure 4: E(p n \\po) for X 2 = T 2 (dots) superimposed on the analogous plot 
for the sphere. 



Then, using the differential equation satisfied by Mathieu functions, it is 
easy to see that the following is a doubly infinite system of real L-periodic 
solutions to Q: 

27TU\ 



g{u) = C \a m (q ), q , —j—J (Mathieu cosine function), 



and 



f(u) = — b n (—q ), —q , —j—j (Mathieu sine function). 



Thus, our solutions depend on two parameters m,n e N*. 

We have studied the relative volume entropy of a sample of these solutions 
w.r.t. Minkowski space as functions of the period-length L. We have found 
that invariably the relative volume entropy scales like L 3 . Figure [H] is one 
example of this behavior. 



3 Discussion 

In this paper, we have introduced the relative entropy of volume, an infor- 
mation theoretical measure in classical gravity, measuring part of the infor- 
mation content of one solution of the Einstein equation relative to another. 
We have studied in some examples how it detects the deviation from ho- 
mogeneity as caused by gravitational radiation and matter. In a technical 
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relative entropy 




Figure 5: Relative volume entropy w.r.t. Minkowski space of a gravitational 
wave with m = 1 and n = 2 as a function of the period-length L (dots), 
superimposed on a plot of the function x >-)■ 0.374 x 3 . 



direction, it would be interesting to extend the theory beyond the case of 
compact spacelike slices and metrics with a preferred time direction. 

It would also be interesting to study the relative volume entropy in the 
presence of a non-trivial Weyl tensor, for example in the light of Penrose's 
proposal of non-activation of gravitational degrees of freedom (encoded in 
the Weyl tensor) at the Big Bang [16J. 

In addition, believe that relative volume entropy could play a role in the 
theory of cosmic structures (compare [17J). Because the gravitational fields 
involved in the formation of structures in the universe are quite weak, it is 
sufficient to ignore the backreaction on spacetime geometry in the pertinent 
numerical simulations. Notwithstanding this appropriate practice, we believe 
that minimizing the relative entropy of a putative analytical model of the 
resulting (backreacted) spacetime w.r.t. to numerical data would provide a 
way of fixing parameters in the analytical model (applying the "principle of 
mean discrimination of information" due to Kullback). 

The natural approach to entropy in classical and quantum gravity often 
is the von Neumann entropy (see e.g. [HI HI]) > an d it would certainly be 
very interesting to study its relation to the present relative entropy. As an 
example of this, in loop quantum gravity, volume is a (trace class) operator 
V (compare [201 I2T1 122]). so it makes sense to consider its von Neumann 
entropy — Tr(VlogV) ( gularized value). Observe that in this case, 
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there is no need for a relative version of entropy (or one may consider it as 
a relative entropy over empty spacetime). Does this "loop volume" entropy 
have a relation to our relative volume entropy (over a suitable background)? 
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